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ABSTRACT 

This is a guide to help teachers at ail grade levels 

to improve the quality of their student assessments . It is designed 
for preservice and inservice teacher education to assist in 
conducting performance assessments to evaluate student learning. 
Performance assessment requires a student to analyze a problem^ 
synthesize information , and attempt to apply acquired information to 
a new problem, si tuatioii . It enables the teacher tp measure a 
student's ability to transfer^ hot just recall^ skills and knowledge. 
The basic aspects of a perfbrmahce assessment are the decisibh 
situatibh, exercise, response, and rating. Perfbrmahce assessments : 
must be handled systematically to produce dependable and useful 

information about student achievement^ The guide provi^ 

instructions for designing a performance test and guidelines for 
maximizing the quality of assessments. (bWH) 
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FOREWOku 



The National Education Associatton supports the 
ongoing testing and ass^sment of student progress. A 
student *s class room performance is the best iridicatibn 
of achieverheht and iristructibrial needs. Sound judgments 
and decisions must be based not on a single pencU an^ 
pap>er test, but on many forms of assessment conducted 
over a period of time: 

Teachers agree on the need for continuous and 
stringent assessments: Classroom instruction, conditioned 
as It is by results of day-to-day evaluations, rriust be 
well planned and conducted to assure reliable arid helpful 
results both for students arid educators. 

Through the approaches discussed iri this publica- 
lion, the relatibriship arribrig assessing, teaching, and 



ieaming is clearly drawn^teachers will find Evalmt- 
ing Students by Classroom Observation useful for piari- . 
ning a broad range of classrckjin evaluatibiis. The ex- 
ercises provide pre-service arid practicing teachers an 
bppqrturiity to examirie ways iri which assessment can 
be thbughtfully and Jjurposefijlly develop^. ^T^^^^ 
proaches that give in-depth information about students, 
teacher judgment is more accurate. 



Sharon P. Robinson, Direclbr; 
Instruction, and Prpfessibrial Etevelbpment 
Natibrial Education Association 
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PREFACE 



This guide can help teachers at all grade levels im- 
prove the quality of their student assessments. Although 
teachers regularly develop and use a variety of asse&s- 
merit methods, this publication focuses on only one irri- 
pbrtaht test type, performance assessmcrit— the obser- 
vation and subjective ratiiig of student behavior and 
products: Research conducted by the Center for Per- 
formance Assessment indicates that performance assess- 
ment is often the most useful tool available for evalK- 
atirig day-to-day student learning. 

There are a number of reasons why teachers should 
have a clear understaridirig of classroom^ performatice as- 
sessmerit. First, most teachers use this form of assess- 
ment extensively to evaluate students' progress arid deter- 
mine the appropriateness of instructional activities: 
For example, a recent study of classroom testing prac- 
tices by researchers at the University of Pittsburgh 
clearly illustrated this po'mi. The researchers concluded 
that 

Standafdized tcstirig [published tests] is thought to 
play a major role in assessing student progress— either 
formatively, summativeiy, or both; Yet overwhelm- 
ingly, Ve found that teachers, when talking of how 
they assess their students, most frequently mention 
'*dbserv&tidri.'\Clearly this favored teacher technique 
is quite qifferent from the kind of iriformatidri pro- 
vided by Standardized tests. Teacher preference, in ef- 
fect, is fOT continuous movies, in color with sound, 
while a teSt score, or even a profile of scores, is more 
akiri to a plack-arid-white photograph.* 



Tkm p^Tfennance assessmerits ha ^ at 'east as much 
in^laenice on siudent development as other test types. Yet 
most pre-iservice and iin-service assessment trairiirig fo- 
cuses on the development and use of teacher-made and 
published obfcctive (e.g., multiple-choice, true/false) 
tests, to the exclusion of other important assessment strat- 
^Si^^iT^RS"*^^ cari fill that teacher preparation gap, 
servF/ng as the basis for in-service or pre-service teacher 
ira;ining in testing. 

Teachers also need to know about p^rfdnriarice as- 
sessment because there are at least as many potential 
problems in developing and using performance tests as 
iri Other fdrms of assessment. Assessments can provide 
'"/Pr™^ion ^jiat may result in incorrect decisions 
about students when— 

• T?^sj^ctivi!Eies are riot similar or standardized 
when standanl condijions are required td create 
equal assessment opportunities for all students. 

• Student responses are too brief td provide reli- 
able information about student proficiency. 

• Performance is rated inaccurately arid irief- 
ficiently by teachers: 

• Scoring procedures lack the detailjieeded to di- 
agnose student needs when the purpose for as- 
sessment is diagnosis. 

__ _Tb'S jguide dvercdmes these arid other potential 
'^^^A'^^'^M^? perforriiarice assessment 

and thereby aids teachers in using perfofmarice assess- 
ment to maximum advantage. 



*Salmon-Cox, Leslie. 'Teachers and Staridardizcd 
Achievement Tests: What's Really Happeriirig?'' Phi Dei- 
ta Kappan, May 1981, 631-34. 
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To reach this goal, the basics of pcrfdrmance aj?- 
sessmehts are introduced in a straighiforward; ste^^^ 
step mahriet guiding teachers throogh the de^^^^ 
merit of a blueprint of a performance test related to their 
owii specific assessment needs, this sequentially pro- 
grammed training Tnethbd.has been used successfully in 
numerous workshops, including trainings sessions heid 
in conjunction with the Annual Conference on Large- 
Scale Assessment of the National Assessment of Edji- 
catiorial Progressiva national conference on Future Direc- 
tions and Assessment in Adult Educatibri, the Iowa 
Conference on Student Assessment, arid the convention 
of the Oregon Educational Research AssociaUon. Fur- ' 
ther, these materials have been successfuily pilot tested 
as an iridividual study guide and as the basis for group 
workshops with teachers in the Portland, Oregon, public 
schools. Thanks to excellent feedback from participat- 
ing teachers, I am confident that this trairiirig can en- 
hance the quality and usefulriess of pefformance as- 
scssmcp', as a rtiethod for assessing student skills. 



Many educatbi-s cbritrjbuted to the development of 
this teacher's guide. Both Nancy Bndgeford arid Jasbri 
Mijlmari reviewed early drafts arid prbvided insightful 
and constructive criticism, Nancy also provided valuable 
edltoriai suggestions, as did Vicki Spandel. Thanks to 
each of these pebple. Thanks are also due to Carol 
DeWitte for her patience in completing the many 
drafts required. 

Finally, I wbUld like to express appreciation to the 
riieriibers of the Portland Association of Teachers and the 
National Education Association for their assistance in 
pilot testing and reviewing this guide. 



Richard J. Stiggins, Director 
Center for Perrormance Assessriierit 
Northwest Regibrial Educatibrial Laboratory 
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CHAPTER i 



INTRODUCTION 
TO PERFORMANCE 
ASSESSMENT 



As a teacher, your assessments of student growth 
and development are very iniportant. They impact stu- 
dents in many ways: They influence not only how rap- 
idly students learn, but more importantly, how rhey feel 
about themselves in relation to school achievem^ent. 
Your assessments also impact the quality and efficiency 
of your ihstructibn. differentiating material mastered 
by students from material you must reteach. Thus quality 
assessment can be a definite asset in your classroom. 
This guide will introduce yoo to many strj^tegies for en- 
suring the quality of your measures of student 
achievement. 

That introtiuction takes the form of a test develop- 
meht simulatibh. You arc abbrit to design ah assessment 
of student achievemem. But. uril^ cbnstructiDg a 
muitiple-choice or true/false test, or administering a stan- 
dardized test, you will neither write test items nor 
count items answered correctly. Rather, you will design 
an assessment that relics totally on your observation of 
arid pfbfessibrial judgmerit about student pKsrformaricc; 
that is, you will design a perforrtiarice assessment. 

WHAT ARE PERFORMANCE ASSESSMENTS? 

Performance assessments require that yoa, the 
teacher, evaluate actual student behavior and/or student 
prbdiicts. Perforrharice assessments differ fi-orh bbjec- 
tive tests in a number of ways. During a perfdrmarice a.s- 
se.ssnient, a student docs more than select the right ari- 
swer or fill in the blank. Instead, the student is asked to 
analyze a problem, symhe^ize information, and at- 
tempt tb apply acquired information to a new problem 
^i^ua^ibri. With pkrrformance assessment, the teacher 
has an important opportunity tb test a stiiderit's ability lb 
transfer, not just to recall, skills and knowledge. 

Perfdrmarice assessnierits take riiariy forriis. They 
can be formal, highly structured icsp in^ which students 
complete specific exercises, and perlbrmance is rated 
according to clearly stated criteria, as in the following 
example: 

The high school English teacher develops an as- 
sessment to select students for a remedial writing 
prbgrani. Each student is askeri tb write twb 
brief compositions. The writing samples are rated 



independently by two English teachers in terms 
of their clarity of expression, organization, and ap- 
propriate use of grammar. Students are selected 
bri the basis of the results. 

In other instances, performance assessments can be 
more casual, spontaneous assessments in which the teach- 
er observes students during instruction to diagnose 
skills arid plari activities. Fbr example: 

While listening to students' oral reading, a third 
grade teacher notices a student cgrisistently faltering 
9X'^''_^^*^?*" sbu'lid.s. The teacher 

makes a note of the problenn f<>r individual work. 

Note that iri both exaniples— fbrnial arid irifonrial— 
the assessment consists of four basic parts: (1) a decision 
situation within which the assessment takes place (i:e., 
a barJc reason for conducting the assessment); (2) a test 
activity br exercise to which the student must respond 
(e.g., a writirig exercise arid bral reading activity iri the 
exaniples;^(3J a^ri actual stude^^ respons/e (e.g^, writirig 
and reading performance); and (4) a rating or judgment 
about performance (e:g:, rating components of writing 
and notking reading difficulty). These, then, are the ba- 
sic aspect.s bf a performarice assessmcrit: 

Decision Situation— reason for the as.scssment; 
spKtcifies the irirorriiatibri you rieed 

Extrcise^idsk giveri to studerit that requires per- 
formarice; specifies what the student is tb db 

Respcnse^acUi^] student performarice; 
.specifie.s the bchavidr dr product evaluated 

/?<2//a2^— evaluatibri bf performarice; 
specifies riiethdd lised to judge pcrfbrriiarice. 

Like all tests, performance assessments can vary 
widely in the information they provide and the manner in 
which they are used. Fbr exariiple, teachers riiay as- 
sess student performance Jdr a rarigc of rcasdris—frdm 
planning instruction to certifying skills for grading to 
selecting students for placement into advanced or remedi- 
al programs. Similarly, exercises can vary from highly 
structured, prepla led test activities tb spbritarieous, in- 
formal classrddm doservatidris. Studerit rcspbri.scs can 
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include any bbscK'able studcht behavior or any product 
that students create. And ratings of performanc^^^ can 
range from formal scales, checklists; and grades to infor- 
mal procedures, such as recording spbiitahebus im- 
pressions or making mental notes. 

these variations in performance test form are illus- 
trated in these additibiial examples of performance assess- 
ment. Here is a structured assessment: 

After compieiing a unit of iristmctibh, a Sf:ience 
teacher_has each student conduct a simple experi- 
merii. The puipbse is to certify masteij of the 
required knowledge and skHls. Students first rate 
their own performance in terms of their succes_s 
in setting up the experiment and their resuUs. Then 
the teacher rates them on the same criteria. 

Since this decision may have a major inflaence on a 
student's grade, it calls for a carefully planned assess- 
ment: A casual observation will not suffice here. If 
fair decisions are to bj made, a carefully planned assess- 
ment of pcrforrhahce is essential. 

However, in the following example, ah informal as- 
sessment is both acceptable and appropriate: 

In analyzing and evaluating the impact of a unit 
oa listening skills bf students, a teacher observes 
students in small group activities. The teacher 
checks students for evidence of attentiveness and 
active listening, making anecdotal notes bn stu- 
dent performance. 

Clearly, in this example, crucial decisions affecting 
a studcni's future are not being made. As a result, pre- 
planned and highly structured exercises, responses, 
and ratings are not necessary. Nevertheless, this informal 
assessment affects an important iri.stmctibnal decision 
for the teacher arid calls for sound and accurate impres- 
sions bf pcrforriiarice. 

These few exariiples bf performance assessments in- 
dicate the range of possible forms and uses of this meth- 
od. But how do performance tests differ from other 
types of tests? That is?me is examined next. 

COMPARING PERFORMANCE ASSESSMENTS 
WITH OTHER ASSESSMENTS 

Gerierally, teachers use two types of tests: objective 
tests and performance assessments. Objective tests in- 
clude multiple-choice, true/false, or fill-in items. 
Some objective test5 are published standardized tests, arid 
some are. developed by teachers themselves. Although 
both pcrformarice arid objective tests have important in- 
structibrial uses, such as\diagnosj.ig student needs, 
placirig students in appropriate instructional programs, 
certifying specific competencies, grading and cvaluat- 
ing programs, they differ in form and often in purpose. 
First, consider these differences in form: 



Rcsfxihstf 



Scoring 



Stiurccs of 
liiaccurale 
Assessment 



Objective Tesi 


Performance Tc<' 


Multiple choive 


Fiffnuil: exercise Uc- . 


True/ fal.se 


scribes required 


Pin in hl:inL. 


pc r fo rmance 


Mafchin}: 


Informal: observaiion 




dUii^^g mstruction event 




results in samples of 




perfornuflcc 


. . j 


i*1i;t*-. or^nize. cow- 


iKri-irWMCr. or fin in ^^^c 


struci the best answc/ by 


hlah* 


speaking, writing, or 




prixiucmg >onicthing 




Rate pcrfofiiiiiiK'e oh ii 




St lie (e.g.. I lb 5) 




C hei k skills as present 




or •jbscnl 




Write anecdotal records 


MiArrwich lo course 


PiK)r exercises 


__ conicni 


Too few samiplcs of 


Pixirly wririen items 


. . P?/foXT^'>f? 


Tov) few Items 




PoK^r iC5»l conditions 


I nadcqu ai c rate r t rai ni ng 


Lack of icst-Kaking skills 


Biased anitudc of raters 


or test anxiety 





Regarding differerices in purpf»s^, when teachers di- 
agribse studerit needs and evaluate their instruction, they 
tend to want as much detailed information as they can 
get. In these instances, performance assessments— obser- 
vation of student behavior and /or {products— provide a 
rich source bf heeded inibnnatidri. On the other hand, 
when cbricerried wit'H grading, class placement, or dis- 
trictwide curriculum decisions, schools may tend more 
toward objective tests than performance tests because 
of the concrete data they produce. 

Thus, in actual practice, performance and objective 
tests send to differ significantly in form and purpose. 
These differences notwithstanding, however, tK)th 
types of tests have valuable role.s to play in the class- 
rbbrii; if developed arid used appropriately, each can 
cbrit rib Lite to a clcarcf understanding of student needs. 



RATIONALE FOR TRAINING GUIDE 

When asked to identify barriers to grcat<:f reliance 
on performance teslji In the classrbbrii, teachers sbmc- 
tiriies cite parerits\ StUd:irits\ or administrators' de- 
mands for more '^objective'' evidence of achievement. 
They want more than subjective opinion; they want 
proof; Performance ratings are sometimes seen as too 
.subjeGiivc. Given this attitude, it i.s useful to explore 
the perf:eived differerices between the "objective" indica- 
tors arid teacher ratings. Very simply, the key di^^^^^ 
crice is that objective lest information is seen as systemat- 
ic while teacher ratings are sceini as unsysten^atic-, 
subjective, and therefore Icsiri dependable. T^siiis ^kachers 
may shy away from ratings in instances whcrt^^ they 
riiay have to deferid their dccisibris. 

Further arialysis, however, shows that this prefer- 
ence for objective evidence on the part bf parents arid 
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^^^I^!?T^ n^^A^^^^^^^.'Jy.^ rejcctidri of teacher bbserva- 
ii'onai skill and/or professional judgment. Rather^ it rep- 
resehis a misunderstanding of the value and methods 
of evaluaiing classroom performance. Therefore the key 
to successfully promoting a role for performance as- 
sessment is for the teachei- to keep performance ratings 
from being or appearing to be guesses. Teachers can 
accomplish this by always being in a position to clearly 
describe all features of the performance test, including 
the reason for assessment, the exercises used, student re- 



sponses, and performance rating procedures. In biher 
_^'?L^5^.^!.Jh^y_i^^?^ ^r^^t j>srformahce assessments as sys- 
iematicaiiy as possible; This kind^f systematic assess- 
mehi Is believable to others: But more importantly, it 
produces dependable and useful information about stu- 
dehi achievement. Those who have a vested interest in 
soUrid edUcaiibhal decisions are rhbre likely to accejjt 

P^i'form if those Rssessrriehis are well 
designed^ carefQliy appiifd, and clearly described. 
This training unit provides one way to achieve that goal. 



EKLC 



Id 



CHAPTER 2 

DESIGNING A PER- 
FORMANGE TEST 



As a teacher, you may ajready use perlorniance as- 
sessments in some fgriTi. Although you may not label 
them as siich or think of them as including a dccisidh 
situation, ah exercise, a response, and a rating method, 
observations and rating of student behavior or prod- 
ucts are an important part of most regular classroom as- 
sessment. The goal of this chapter is to help you make 
your assessments of performance as systematic and accu- 
rate as possible, so that you and others will have max- 
iriiuni cohfiderice in the appropriateness of the results. 

This goal is accbrriplished by ihtroducirig ybU to a 
step^by-step sequence for (I) describirig the decision situ- 
ation, (2) dcsighing the test activity, (3) describing the 
response, and (4) selecting the rating procedures. When 
the performance assessment results have a crucial im- 
plication for students, such as when a grade, promotion , 
or high school gradiiatibri rests in the balance, s high- 
quality, carefully striictiired assessment is esscnUal. In all 
such cases, the complete planning sequence described 
here should be followed: However, the test design pro- 
cess includes many detailed steps. Thus it would be 
unrealistic to cxpKct you to proceed through this entire 
sequence when you wish to measure performance in 
less formal contexts. But eve h when a casual or sponta- 
neous assessment is possible, your familiarity with tfc 
developmental sequence described here will help you find 
ways to make student assessment as useful and accu- 
rate as possible. 

The distinction between systerhatic, preplanned as- 
sessnients and in forma! assessrhents i.s essential iri under- 
standing how to take full advantage of the potential of 
perfbrmaricc asscssmcrit. Both types have a major role to 
play. As you proceed through the design puyca^i; that 
follows, you will be asked to design the prototype of a 
forntal assessment to use in your classroom. But as 
you complete this process, rerriaih aware of the fact that 
you should also be able to describe your ihfoimal^ 
spontaneous observation and judgment in these same 
terms. Forinal and informal assessments are compared 
agam In Chapter 3, u hich deals with issues of ensuring 
test quality. 

PREPARING TO DESIGN THE PERFOSMANCE 
ASSESSMENT 

To begin the test design p^^occss, consider your 
classroom for a mornen? and identify an important exam- 
ple of performance that you have assessed or may 
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wish to assess in the future. It may involve evaluating 
student5»' communication skills (writing, speaking, lis- 
tening, 01 oral reading skills) or students' ability to pro- 
duce a specific product (an art project or a typed let- 
ter), for exarriple. Iri other words, identify a specific^ 
situation iri which you either observe the student dem- 
bristratirig a skill or evaluate a completed product: When 
you have selected such an as.sessment context, you are 
ready to begin the process of performance test design. 

That process includes four steps. Each step contains 
a series of test design questions and several design alter- 
natives for answering each question. Examples are 
given tb help you uriderstarid your test design options, 
arid helpful hints arc included with each step to aid in 
making a design choice. A ' 'Blueprint of a Performance 
Test" has been provided at the end of this chapter 
(see pages 17-19) for recording your chbices. Be sure to 
use this blueprint as you design your assessment. Tb 
a.ss!st you in this activity, two completed test blueprints 
are provided iri the Appendix of this guide: 

Strp J: Describe the Assessment Situation 

Iri de.sigriirig a performance as.sessmerit, the first 
.step is tb specify the decision situation or reason for as- 
ses.smerit; that is, ybu mu^^t specify how the test results 
will be used: Since this consideration strongly influences 
the kind of as.sessment developed, carefully describe 
your assessment situation by ah.swering the four que.stibris 
that follow. 

A. What is the reasbri for a.sses.srrierit? 

Table i .specifics various possible reasons for as- 
se.s.sment. Select the decision(.s) from thi.s table that 
your assessment should help ybu riiake. Ybu 
may chbo.se rribre lhari brie, br ybu may wish to 
ideritify a situation hot included in the table. The 
objective is tb make the asse.ssment purpose explicit 
(e:g:. to diagnose skills, to evaluate the effec- 
' tiveness of in.struction), Enter your rcasbn(s) for as- 
.sessment on the blueprint form. 

B. Who are the decisionmakers? 
As.scs.sniei.l rcsnU:> may be u.sed by different 
people -^teachers, parents, school board members, 
administrators, students, arid cburiselbrs— to 
make decisions. List the names arid titles bf iridi- 
vjduaLs who will make decisibris based bri your 
asse.s.smerit iriformation. If you are the decision- 
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TABLE 1. SUMMARY OF VARIOUS REASONS FOR ASSESSMENT 



Mosi Cbnimdh DecisibrirriaRcrs 



Assessment 
Context 



Deeision lo be 
Made 



Aehicvenieni 
lotbrtnaiion 
Needed - 



-Students 



Purcnls Teugher.v 



Diaunosi.s 



Pi ace men I 



CiuuUnee and 
Counsel ih^ 



Si'U'ifion 
Deris tfnt.\ 

Adrtiissiori 



CertitlcaJiori 



7)<i">\ 

Survey 
assessment 



Formative 

program 

evaluation 



Suhiihative 

program 

.^valujlion 



mastery 
or spceified 
knowledge 
()r skills 



Determine 
overall 
aehievemeni 
level of 
students in 
program 

IX-eide program 
components 
in need of 
modincation 



Deteriiiirie 
if program 
is to be. 
"adopted, 
expanded, or 
discontinued 



Decide students' 


Level of 


stretigihs aiui 


development 


weaknesses 


iXf.specHnc 




skills in indi- 




> luuji siuuLni 


Match student 


rrifivrhialioh that 


to appropriate 


places students 


level of 


on relevant 


instruction 


knowledge or 




skill continuum 


Decide chances 


Level of edu- 


of success 


cational develop 


and satislbction 


ment of indi- 


in various 


vidual stu- 


prog ranis 


dent relative 




to program 




requirements 


ChtHise 


Informaiion that 


students lo 


ranks students 


be ad matted 


bh relevant 


into program 


knowledge or 




skill continuum 



Information 
reflecting 
individual 
sluderii rriasiery 
of specified 
btxly of 
kriowledge or 
set of skills 



Average 
achieverrichi 
scores for 
groups of 
students 



In tended 
outcomes 
attained and 
hot attained 
by partjeipating 
students 

Program 
outcomes 
attained arid 
not attained 
by participating 
st Ode fits 



ERIC 



1^ 



litiker, indicate this oil the blueprint. If others 
arc involved, so specify. 

C. What knowledge and/br sec of skills is the exam- 
inee expected to apply? 

Specify iri as rriucH detail as pbssiWc the body of 
knowledge arid/or set of skills to be dembristrated 

in the assessment. L^tcr you will specify the 

performance task the student will complete to dem- 
onstrate the required knowledge or skills: But 
for now, simply describe the basis of your perfor- 
mance expectatibris. What do you exfXJct the stu- 
dent to know or be able tb db? Enter this bri the 
blueprint. 

b. Who arc the students tb be tested? 

Describe the grade level, approximate number, 
and other relevant characteristics. 

Stvp 2: Finn the Test Exercise 

in any assessment, time and re^sources are limited^ 
Resources commonly do not permit testing the student's 
proficiency in performing all relevant skills. Therefore 
most assessments are based on a sample of relevant 
tasks. Your second step is to describe the tasks you 
plan tb use tb sample student skills. Tb accbmplish this: 

• Describe the test activity. 

• Determine whether it will be assessed formally 
or infbrmally. 

• Decide the number of performance samples 
needed. 

• Determine who will supKsrvise the assessment. 

In Step 1, part C ybu described the kiibwledge bi- 
skills the student is tb demonstrate (e.g., demonstrate the 
ability to think critically or to write an organized para- 
graph): In Step 2, you will describe the specific context 
and task(s) you will use to provide students with an 
opportunity to demonstrate this proficiency. 

A.Will you assess student performarice by observing 
everyday activities in or outside the classroom, or 
by creating a specific test activity tb measurej>er- 
fbrmance? Note: Both can be used if you wish: 

Optibri 1 : YbU itiay use typical classroom 
eVent(s) to provide evidence of 
student skill: 

Example: You may observe and 

evaluate students as they plan a 

group presentation, solve a 

word problem in math» or set 

lip ail experiment. \ 

Option 2: You inay design a specific test 

exercise tb cause students tb per- 
fbrtti specific tasks so that you 
can evaluate performance. 



Example: The fifth grade teacher 
uses a pj'bblem-sblving simulatibri 
to observe and rate the problem- 
solving skills of each student: 

• Helpful Hints 

1 . Ihfbi'mal bbserVatibiis bf riatui-al class room ac- 
tivities provide an appropriate basis for an as- 
sessment if 

a. Those events are readily available, easy 
to use, and likely to produce the behavior 
you need to evaluate. 

b: Your resources are limited — it costs time 
(and perhaps money) to develop hew test 
activities. Since normal classroom events 
occur whether ah assessment is being 
cbhdUctcd bi" riot, they require no addi- 
tional costs: 

c. Ability tb apply kribwlcdgc or skills can 
be effectively measured in a natural 
•setting: 

d. You wish to measure typical performance 
rather than test possible performance. A 
preplanned and highly structured test cx- 
erci.se rtiay distbil ''typical" pei'fbrmarice 
due to test arixiety bi* artificial, cii'curti- 
.starices of testing. 

c. The assessment task docs not have to be 
identical for every student. Because 
teachers cannot observe all students aL_ 
once^ the performance evaluated at differ- 
ent tirties will be sbrriewhat different fbi* 
each student. 

2. A preplanned, striictut'ed pei'for'marice exercise 
should be used if 



a. 



Natural events are unlikely to produce an 
easy-tb-bbscrve, appropriate sample of 
behavior: 

Ybu have resburce.s (tijne, ™ney, and 
ideas) to develop and evaluate the 
exercises. 



A standard testing situation is required to 
allow each student an opportunity tb re- 
spond to the same test activity. 

Make youi" choice, enter it on the blueprint, and 
provide a brief description bf the nature bf ybur 
classroom events br exei-ciscs. 

B. Hbw many assessment tasks br samples bf perfbr- 
rtiance will ybii riced tb accurately jtidge a student's 
skill? 



Option 1 : You may use bne assessment exercise. 

Example: Require brie brief essay tb 
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judge a sliidcht's general writing 
proficiency. 

Option 2: Yoii may lisc several exercises. 

Example: Use three different writiiig 
activities to evaluate a student's 
ability to summan>,e information or 
argue persuasively,: 

Option 3: Or you may choose to use several 

assessment exercises over a period of 
time. 

Example: Require vvriting in a journal 
throughout the school year to judge 
chnn^'cs in writing proficiency. 

• Helpful Hints 

1. Gather as mach evidence as the reason for as- 
sessment demands. Important decisions, such 
as whether or not to promote a student to the 
next grade, require enough information to be 
absolutely certain your decision is correct. 

2. A .single bbservatibn of performance can be uh- 
dcpendable. Several samples conducted over 
time arc usually needed to be confident of your 
assessment. Collect as much evidence as the 
time frame will permit. Indicate yosr choice of 
options on the blueprint, along with the reason 
for selecting the number of exercises. 

Specify the number of exercises on the blueprint 
and indicate the rea.sbh for your choice. 

C. Who will supervise or administer the assessrrierit 
activities, you or the students? 

Option I: You may opt to supervise assess- 
ments yourself. 

Example: The teachei- obsci'ves and 
rates science students' ability to 
set up and conduct an experiment. 

Option 2: You may allow students to ad- 
minister their own assessment. 

Example: Over a five-week period 
students rate their own listening 
perforrriarice in ten informal cbriver- 
sat Ions. 

• Helpfiil Hints 

I. Use teacher-supervised events if 

a. The student has some vested interest in 
high i>crformance (e.g., a grade rests in^ 
the balance) arid the objectivity of the re- 
sults must be assured: 

b. The exercises rieed to be ideritical fbi* all 
stuxlents^ You must ensure standardized 
conditions. 
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rate resulting performance. 

d. A skilled professional is needed to judge 
performance accurately; 

2. Consider unsupervised exercises if 

a. Students have no reason to misrepresent 
their level of skill (nothing to gain). 

b. The activity need not be exactly the same 
(standard) for every student. 

c. Too much time is reqiiired for you to su- 
pervise each activity individually. 

d. A product results that can be evaliiated 
later (e.g., a writing sample, a video- 
taped speech). 

Consider your choices, select Option 1 or 2, and 
enter your choice on the blueprint. State briefly 
why you selected the option. 

D. Provide a specific example of the activity or test 
exercise you plan to use to bring about the stu- 
derit's respbrise. 

How will you frame the problem for the stu- 
dent? Provide an example on the blueprint. 

Step 3: Describe the Performance to Be Evaiuuted 

in Step i, you outlined the reason(s) for assess- 
ment, and in Step 2, you decided upon test exercises. 
Now your task is to describe the kind of student pcr- 
fbrmarice br respbri.se to be evaluated. Db sb by ariswcr- 
irig the three qucstibris that fbllbw. 

A. What kirid bf pei'*brmarice will you evaluate? 

Optibri 1 : Ybu cari bbserve arid rate a process 
or bchavibi- as it occurs. 

Exariiple: A kiridergarteri teacher 
observes and evaluates a student's 
interactions to judge social develop- 
ment. 

Option 2: Or you may observe and evaluate 
a product developed by the student: 

Example: An industrial arts teacher 
evaluates the quality of a woodworking 
project. 

Refnemher: You may choose to evaluate both 
the behavibr arid the result. 

• Helpful Hirits 

1 . Rely bri process br behavibr ratirigs if 

a. The process is rtldi-e iriipbrtarit thari ariy 
resultirig product br there is rib prbdiict 
(e.g^,^ evaluation of motor skills in physi- 
cal education). 
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b: The performance t to be conducted in a 
step-by-step manner and deviations are _ 
unacceptable (e.g., cbriductirig a scientific 
experiment in a science labdratdry)^, 

c. You have tirric available to bbscrv^ stu- 
dent behavior brie-td-brie as it is * 
occurring. 

2. Rely bri prbducl rating if 

A tangible product results from the activ- 
ity (e.g.. a mechanical drawing dr a sam- 
ple df wriling). 

b. The quality df the prdduct is mdre impor- 
tant than the way it was produced: 

Select frdm ydiir dptidris arid eriter ydur chdice 
on the blueprint, along with a brief description of 
the process or product to be assessed. 

B. What specific aspects of performance will ydu 
evaluate? 

List as specifically as possible the criteria for 
evaluating a student's performance. What char- 
acteristics of the process or product will ybu 
judge? Fbr example » iri a speech, you may judge 
cdriterit, drgariizatidn, and presentation. Given 
the performance ycu are^to^ evaluate » on what 
will you base your judgment? 

Note: The quality and usefulness of a perfor- 
mance assessment are determined more by clear- 
ly defined criteria than by any othei single 
factor. Therefore cbrisider ybur answers carefully. 

Exampie: The two blueprinis in the Appendix 
include illustrations of performance criteria. 

• Heipfol Hints 

i : Spell out important pexformance outcbmes pr- 
or to the assessrrieht. This will iricrease the 
quality arid efficiericy df your evaluations: 

2. To rate a {jrbcess, state the perfdrmarice crite- 
ria iri terms df observable behavior (i:e: , ac- 
tidris that can be clearly seen and documented). 

3. - Wheri evaluatirig prdducts, be explicit in stating 

required attributes. 

4. Carefully distinguish between performance cri- 
teria (attributes to be evaluated such as organi- 
zation, content, mechanics in writing) and per- 
formance standards ^levels of achievemerit dr 
scores bri thbse attributes). The issue of stan- 
dards (acceptable or Uriacceptable perlfbnnance) 
is addressed in Step 4 in the discussion of scor- 
ing procedures: 

5. Make sure there is a match between the skill 
you want to teach and the criteria you choose 



to measure success: Attitude, class attchdarice, 
and amount of class participation are usually 
inappropriate criteria to use in judging whether 
a student can cbrriplete a specific task. 

Specify ybur criteria iri the space provided dri the 
bluepririt. 

C. Will stiiderits whdse perfdrrtlance is to be evaluated 
be aware that ari assessrnent is td take place? 

Option 1 : Ybu may opt for ari open, public 
assessrnent. 

Example: The teacher of a computer 
programming dass^asks students to 
write three programs, to make them 
operate, and to submit results for 
evaluatibri. 

Option 2: Or you may conduct your assessment 
unobtrusively. 

Example: The teacher of a cbriiputer 
prbgrarrirriiri^ class walks arburid the 
cbriiputer lab dbservirig stiiderits 
operating terininals. Without 
announcing the evaluation, the 
teacher notes those students having 
difficulty with particular bperatibris. 

f^otc'. All objective tests must be publicly con- 
ducted ^Everyone knows an assessment is takirig 
place. This is riot riecessary with perfdrmance 
tests. The pdssibihty of unobtrusive assessment is a 
real strength of performance assessment. 

• Helpfiil Hirits 

1. Iri sdme instances, there are important moral 
issues to be addressed in conducting unan- 
nounced evaluations: Essentially those who use 
unobtrusive evaluation must be sure they re- 
main sensitive to the studerit's right tb privacy. 
They miist alsd be aware that students' motiva- 
tidri td peffdrm can be influenced bojh positive- 
ly and negatively by the awareness that an as- 
sessment is underway. 

2. Conduct unannounced assessments when you 
are interested in learning how students typicaily 
perform. When ybu warit tb kribw what is the 
best studerits cari dd, it may be better td con- 
duct ari ariridiiriced assessment. 

3. Fbr spriie studerits, ariy assessment causes de- 
bilitating anxiety. As a result, performance suf- 
fers and an invalid assessment results. If ex- 
treme anxiety is an issue, consider unobtrusive 
assessments. 

Select from among your options and enter your 
choice on the bluepririt. If ybu select liridbtrUsive 
assessriierit, state why. 
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y) 4: Desif^n a Plan for Katinj^ and Recording 
rfimmmve 

The guaiity of performance assessment is deter- 
neci to a great extent by the quality of the scoring pro- 
Jurcs used . Because performance assessment reiies 
subjective judgments rather than on. a count of correct 
ipohscs, it is necessary to use spe_cial care to be sure 
; assessment is cai-cfuUy scored. To ensure quality, 
nsidcr the four questions that follow. 

A. How detailed a record of performance is heeded? 

Option 1: You may want a sing^le overall 

prbiTciency score (holistic scoring). 

Example: A writing sarhple is given 
a single score that reflects overall 
writing skill. 

Option 2: Or you may wish to have perfor- 
mance broken down into components, 
with each part rated individually 
(analytical scoring). 

Example;^ T\\\x^ graders' oraj reading^ 
skill is observed and evaluated in terms 
of sight vocabulary, fluency, and 
apparent anxiety. 

• Helpful Hints 

1 . The scoring method must relate to jhe purpose 
of the assessment. Some testing purposes re- 
quire detailed analytic information, while oth- 
ers require more general information on stu- 
dent performance. 

a. Holistic scores are appropriate for grad- 
ing, grouping, arid placement decisibris. 

b. Arialytical scojes are often iieeded for di- 
agnosis, certificalibri bf skill masteiy, 
and evaluation of effectiveness of instruc- 
tional treatments. 

2. Consider the resources available to observe and 
rate performance: Analytical scoring requires a 
more in-depth examination of the performance 
arid therefore riibre teacher time than hblistic 
scbririg. 

3. Both hblistic arid arialytical scoring riiay l^ 
used together in certain situations if two differ- 
ent kinds^f information are needed^ For exam- 
ple, you may evaluate overall performance for 
each student, and then analyze the reasons for 
poor perforriiarice ambrig thbse with low 
scores. 

Enter your choice on the blueprint together with 
a brief restatemerit bf the purpK)se bf your 
assessment. 

B. Whb will rate or evaluate performance? 



Option 1 : You, the teacher, can observe and 
fate student pcrforniarice. 

Optibri 2: Othei- teachei-s can observe arid fate. 

Optibri 3: Students can bbsefve arid fate each 
bther's peffofrilarice. 

Optibri 4: Studerits can observe arid rate their 
own pei'fofrnaricc. 

• Helpful Hints 

1. Use teacher ratings ((Dptions j and 2) if 

a: Rating performance reqaires IfiigSly spe- 
cialized knowledge that omy trained 
teachers possess. 

b. The same set of standards must be ap- 
plied uniformly to all ratings. 

c. The student has a vested interest in re- 
sults (e.g., a grade rests in the balance) 
arid rriay be perceived as havirig the op- 
pbfturiity tb beriefit urifairly frbrii self^ 
scoring. 

d. Resburces (time) are available for the 
teacher to do the observations and rat- 
ings: If another teacher is to be used, 
time must be available for training that 
person to do the rating. 

2. Consider peer or self ratings (Options 3 and 4) 
if 

a. Highly specialized knowledge is not 
rieeded tb rate perforriiarice. 

b. Slight yariatibris frbm rater tb rater are 
acceptable iri usirig the scbririg criteria. 

c. Studerits have rib vested interest in artifi- 
cially iriflatirig bf deflating their peffor- 
niarice fatirigs. 

d. Resburces afe liriiited—studerits represent 
a low-cost, effective scoring resource, 
and they can learn by critiquing them- 
selves and others. 

e; Students can be trained to become objec- 
tive evaluators and to avoid overly criti- 
cal evaluations bf self and others. 

3. Whenever possible, consider usirig riiore than 
one rater. Cbmbiriatibris bf teacher and self 
fating, for exariiple, cari yield riibre cbriviricirig 
Irifbfmation than can a single rater. 

Select ybur rater(s) arid eritef therri bri the 
blueprint. 

C. What riiethbd will be used tb fccbrd perforriiarice 
assessriierit results? 
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Option 1 : A checklist of attributes present 

or absent in the studeiit's pcrfoririaiice 
(e:g., characteristics of a good speech) 
call be used. 

Option 2: Rating scales that report degrees of 
proficiency derribnstrated by the per- 
former (e.g., a letter grade or a | 
to 4 rating scale applied to an essay) 
can be used: 

Option 3: Anecdotal records of important 

behaviors or products (e.g., written 
comments on qualities of written 
products or ciassrddrh participation) 
can be used. 

Option 4: Menial notes and/or records of. 

performance (e.g., making a mental 
note of a particular success or prob- 
lerh ericburitered by a student) can be 
Used. 

• Helpful Hints 

1 . Rating scales and checklists have the foUbwirig 
advantages. 

a. They combine ihc observation with a 
judgment, resulting in ah easy-tb-ihterpret 
recbrd. 

b. They can be developed for prck:ess evalu- 
ations (checklist bf steps comjpleied) as 
well as product evaluations (rating 
quality): 

c. They can be tailored to many different 
performance criteria: 

d. They provide a convenient frame of ref- 
erence for comparing and interpreting 
student performance. 

e: Data can be recorded quickly. 

2. Anecdotal records have the following 
advantages: 

a. They can be used to record either behav- 
ior or product information. 

b. Behavior is described as it occurs without 
judgment. 

c: Records can focus on unique events or 
behavior that may be bverlboked with 
other rating schemes. 

3. Rating scales can focus efficiently oh many at- 
tributes of rhariy students, while anecdotal re- 
cbrds are best with a few students and a few 
significant traits. 



4: Aisecdotai records are tlme-cohsumih^ to gath- 
er and use. They are hot rhearit for all occa- 
sions, ribr for eyei-yday use, hbr fbr all stu- 
dents at brice. But when a detailed record or a 

quick hbte is heeded, they can serve well. 

Written or tape-recorded anecdotal records are 
always preferable to mental notes. 

5. In using mental note^, important information 
can be forgotten or misinterpreted when at- . 
tempting to remember the event. This can bhly 
be avoided by using written recbrds. Write 
down that judgrneht in ah ahecdbtal j-ecbrd or 
use a taperecbrder. Do not try to remember 
key aspects of student performance! 

Select ybur recbrdihg process bh the blueprint. 

b: How are the performance test results to be 
interpreted? 

Option i : You may compare each student's 

performance with that bf bther students 
(e.g., a grbup norm). 

Example: Students are ranked on their 
ability tb play a rnusical instrument 
to determine seating in the band. 

Optibh 2: Or you can compare each student's 
performance with a preestabUshed 
standard of acceptable performance. 

Example: Students demonstrate skill in 
ten specific speaking competencies in 
oral presentations. 

• Heip^i Hints 

1 . The way performance is interpreted relates to 
the reason for assessing performance. Sbme de- 
cisions require studeht-tb-studerit cbmparisbhs, 
such as grouping, guidance, and placement 
decisibhs. 

2. Other decisions require cbmparihg each student 
with a standard. Those include d|agnqsing, cer- 
nfyingjtiastery, and evaluating instructional 
programs: 

3. Both modes of interpretation with a specific 
performance te.st may be appropriate, depend- 
ing on the range of decisibhs that are based bh 
results. For instance, students may be ranked 
oh byerall performahcis, and f^'' P^.^f^f^^"^^ 
may be reanalyzed to determine which skills 
were not rfiastered. 

Describe your mode of interpretatibh bh the 
blueprint and state why ybu selected that mode. , 
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I . Decision SitUatibii 

A. Reason(s) for Assessnient 



BLUEPRINT OF A PERFORMANCE TEST 



B. Decisionmakers 



C. Knowledge/Skills to Be Assessed 



D. Students to Be Assessed 



ERIC 



18 



17 



2; Test Exercise 

A. Nature of Evcht(s) * 

Naturally occurring ciassrobm eveht(s). Description: 

^ Structured exercise(s) Description: 



B: Number of Exercises 

One exercise one time: Reason: 



_ More than one exercise at one time. Reason: 



More than one exercise over time. Reason: 



C. Exercise Admihistratibh 

Supervisti by teacher: Reason: 

Unsupervised (self-administered by student): Reason: 



b. Sample Exercise Description 



3. Performance to Be Evaluated 

A. Forms of Performance 

z:^:^ Process rating. Describe: 

Product rating. Describe: 
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B. Specific Pcrfdrrhahce Criteria 



C Test Awareness 

Open, public asspssmcnt. 

Unobtrusive observation: Reason: 



4. Rating Proc'cdurcs 

A. Type of Score 

- — Holistic: Assessment purpose: 



Analytical. Assessment purpose: 

B. Rater 

Teacher rates own students 

Other teacher 

Peer 

Self 

C. Rating Method 

Checklist 

Rating scale 

Anecdotal record 

• — Mental note 

D. Interpretation Plan • 

Norm -re fere need. Reason: 



Criterion-referenced. Reason: 



CHAPTER 3 



GUIDELINES FOR 
MAXIMIZING 
THE QUALITY OF 
ASSESSMENTS 



The development and use of sound performance as- 
sessment requires knowledge, planning Jas described in 
Chapter 2), and an awareness of the pitfalls common 
to sound assessment. This chapter offers a list of specific 
guidelines to aid in maximizing the quaUty a^^^ 
ness of both preplanned and jnformal performance assess- 
ments. These guidelines promote the following: 

Clear reasons for assessment 

Clear communication about assessment 

bbjectiviiy 

Validity 

Reliability _ 

Economy of assessment 

Aithough the research on the use of classroom per- 
formance assessment suggests that teachers adhere to 
some of the quality cbritrbl strategies discussed, not aU 
(or even most) teachers typically employ enough of these 
strategies to ensure the quality of their perfomarice 
assessments. As you review the guidelines, evaluate your 
own quality control efforts by placing a check next to 
those you regularly follow. 



CLARITY OF PURPOSE 

The key to test quality, as noted earlier, is to real- 
ize that, without a clear purpose; appropriate asses.sment 
strategies cannot be selected. Keep these points in 
mind with respect to test purpibse: 

j : Know the ^^cision to be made arid the decision- 
maker before you start plaririirig the assessment: 
2. Clearly understand the skills that must be mea- 
sured to achieve the purpose arid select an assess- 
ment activity that provides appropriate and rele- 
vant iriformatibri. 

a. If you wish to measure recall of facts arid rela- 
tionshipis, consider usirig ari bl^ective test, as it 
is a valid, reliable, and ecbribmical means of 
assessing kribwledge acquisition: 

b If you wish to measure ability to apply infor- 
mation, to Mse a skill, br to produce a product, 
performance assessment is an excellent method. 



tfcARlTY OF COMIMUNIGATION 

Students arc able to show you their best perfbr- 

mance only if they understarid the requirements of the as- 
sessment. If you fail to clearly communicate what is 
required, studerits may fai[ to perform adequately not be- 
cause they are incapable, but because they are un- 
aware of your expectations. Two ways to help studerits 
understand are as follows: 

1 . Clearly explain to students what is tb be done and 
how it is to be done. Illustrate the dimensions of 
appropriate perfomiarice, then see if students can 
dembristrate them. 

2. Promote clear understaridirig by making expecta- 
tions clear pribr tb the assessment. Make clear 
and explicit the characteristics of sound perfor- 
mance (performance criteria) and the staridards br 
levels to be^attained: 

FREEDOM FROM BIAS 

The goal in any assessment is tb be sure the resuil 
reflects student capabilities rather than the attitudes or id- 
iosyncrasies of the iridividual who rates the perfor- 
mance. Tb reach this goal: 

1 . Avoid perforriiarice assessments that give one stu- 
derit ari Unfair advantage over another siriiply be- 
cause of factors related to cultural background: 

a. Remairi sensijive to the cultural perspectives of 
all students involved in assessriierit. 

b. Use performance exercises that all students un- 
derstand; provide equal oppHorturiities to all 
students. 

c: Remain aware of any tcridericy to overrate the 
performance of studerits frbm your own sex, 
ethnic, br racial group in relation to that of stu 
derits frbm other groups. 

2. Employ scbririg procedures based on clear, explic 
it perfdrmarice criteria, predefined scoring rules, 
arid careful rater preparation (trairiirig) iri 
observing. 



2D 



21 



3. Avoid iisiri^ mental record keeping. Write down or 
tape-record notes and evaluative judgments. 

4. Be aware of common classroom assessment 
problems: 

a. Avoid being influenced by prior knowledge of 
student pcrfdi-maricc in another area wheii rat- 
ing a particular behavior— halo effects. 

b. Do riot be irifluericed by irrelevant characteris- 
tics of the student (e.g., personality traits) iri 
rating achievement. 

c: Be jure to use the eritire rating scale. When ex- 
treme ratings are warranted, give them. Do not 
be drawn automatically to the middle of the 
scale when mid-range ratings are not justified. 

5. Whenever possible; rate student performance "in 
the blind," i.e., without knowledge of the identity 
of the studerit whose product you are evaluating. 

In planning and preparing classroom assessment, be 
certain to avoid all forms of bias. 

VALIDITY 

The validity of an assessment reflects the extent to 
which the measurement procedure actualiy provides in- 
forriiatibri about the student attribute you intend to 
measure. Orie characteristic that is often associated with 
validity— freedom from bias— has already beeri dis- 
cussed: To maximize the amoum of^elevant information 
derived from observations of performance; adhere to 
the following guidelines: 

1 . Be clear on the porpose(sj of assessment. The 
more important the purpose, the more certain you 
need to be of the accuracy of your judgments. 

2. Be sure the behavior or product observed relates 
to the characteristic you wish to assess. 

a. Clearly define the characteristic to be 
evaluated. 

b. Specify differences in levels of proficiency on 
the rating scale. (Decide what adequate and in- 
adequate performarice means iri terms of 
skills.) 

3. Develop a wide variety of exercises to measure 
the same skill. Use diffetem kinds of writing ex- 
ercises; speaking tasks; product development 
prbbLems. Allow the diversity of exercises to mir- 
ror tfie broad array of contexts in which students 
might use the skill iri questibri. 

4. In some cases, you can use objective tests and 
jKrrornciarice assessmerits to cross-check studerit 
capabilities. For exarriple, both objective lariguage 
usage tests arid writing samples are capable of 
providing information on writing proficiency. 
Used in combination, they offer the economy of 
the objective test balanced with the richness of in- 




fdritiatibri pj-bvided by actual writirig samples. 
5. ioonduct unobtrusive assessments in those cases 
where artificial test situations arid/br cxtrcrnc test 
anxiety may distort student perforrriaricc. 



RELIABILITY 

The reliability of an assessmem reflects the exlim 
to which you can depend on the information provided: 
Dependable assessments prbvide consistent informa- 
tion. Differerit test exercises desigried tb assess the same 
^J?*Lshould yield cbrisisterit scores for a giyeri examiri- 
ee; Ratings made by different scorers should also agree. 

Many aspects of the assessmerit, its admiriistratibri, 
and the student can interfere with obtairiirig reliable re- 
sults. Inattention to any of the following can reduce 
the reliability bf your assessments: 

1. Undependabie performance ratings can result from 
Idw-quality assessments. Avoid these effects by 

a. Stating clear purposes; specifying performance 
' criteria, and using unambiguous exercises and 

respbrise requiremerits. 

b. Gatheririg eribugh samples of appropriate per-' 
forriiarice tb be confident in judging the stu- 
dent's level bf skill. 

c. Scbririg carefully arid usirig explicit procedures 
and trairied (qualified) raters. 

2- y ".dependable results cari occur frbm poor test ad- 
ministration practices. Avotd\hcsc cffect.s by 

a. Wiriimizirig distractibris tb the .studerit duririg 
assessment: 

b: Providing for uniform exercises, respbrise, arid 
rating where needed. 

3; Undependabie results can be caused by character- 
istics of the student: Minimize these effects by 

a: Using interesting, challenging test activities 
that motivate the student to respond. 

b. Reducing test anxiety by providing practice and 
experience with the assessment activity: 

c. Acknowledging that students have gocxi and 
bad days and repeating your observations over 
tirhe tb allbw for this factoi*. 

The riibrc crucial the decision to be based on assess- 
ment results, the mbre iriipbrtarit reliability becomes. 

ECONOMY OF ASSESSMENT 

When asked what, if anything, keeps teachers from 
usirig performance assessments frequently; they some- 
times re^rt that they have insufficient time to develop 
and cbriducl such assesfrierits. This problem can Be ad- 
^''^^^^♦JlLP^'t'.^y _d^^^^^ ecbribrtrical assessriierit 
activities and scoring procedures. 
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Exercises 

Three specific strategies, can be used to reduce the 
complexity and costs associated with developing test 
exercises: 

1 . When structured exercises are to be iiscd in pre- 
planhed. s^sterhatic assessments, reiy on inexpen- 
sive, readily available options such as written 
problem situations, role playing, small group ac- 
tivities: Complex and costly simulations are rarely 
necessary 

2. Conduct an efficient assessment: One sample of 
student performance (e:g., a single writing sarh- 
plc) Is often insufficient to draw cbriciusions, but 
three or Four may be ehbugh. Carefully consider 
how much informatibri is enough for your situa- 
tion and db libt exceed that amount. The^ 
crucial the decision, the more performance sam- 
ples you need: Be careful not to ovcrsarriple, 
however: 

3. Save creative, workable performance exercises for 
reuse with different classes or at a later time. 



Scoring Procedures 

Six ways to make scoring mbre efficient are as 
follbws: 

j . Whenever possible, judge perfbrmance t?Ji the ba- 
si.s of a product rather than a process; 0bservlng 
students carrying out procedures one-to-one is 
time-consuming. Products can be rated mbre 
qusckiy. 

2. Rely bn hblistic scoring whenever it is appropriate 
arid it meets the purpose of testing. If you do not 
need an analysis of the subparts of performance, 
do not generate one. Do not waste time rating fac- 
tors unrelated to the decisibri ybu itliist make. 

3. Use concise checklisls and rating scales when pos- 
sible. These 3llow you to focus on ihe important 
traits and permit you to recoid performance mbre 
qoickiy than with anecdotal records arid more de- 
pendably than with merit?] ribles, 

4. Specify clear, concise performance critena; focus 
on important characteristics and disregard bthers. 

5. Train and use volunteer raters when pryssible. V^^^ 
ents, aides, and bthers cari be valuable resources 
iri this respect. But you must (a) make rating cri- 
teria clear, (b) trajn raters very carefully, and (c) 
be careful not to rely on volunteers tb fulfill the 
teacher's rating responsibilities. 

6. Take a^varitage of peer and sfelf losing when pos- 
sible. This can be a valuable learning ei^perience 
for students and it can free you to do other thirigs. 



MAXIMIZING QUAblTY 0F SPONTANEOUS 
ASSESSMENTS 

the foregoing strategies for irriprovihg the quality . 
o\' performance assessrriehts deal predbraiiiaritly with for- 
mal, preplanned assessriierits. But informal assess- 
inerits of stiiderit performance— 2 very common of 
ciassroom assessment—can also be improved by ad- 
hering to the guidcHnes presented: informal, sponianeous 
observations of students provide an extremeiy impbr- 
sant source of information for teachers in all subject ar- 
eas. For example, in ari oral i'eadirig group, the teach- 
er notices a studerit havirig difficulty with certam 
bcgiririirig letters. In a science lab^ the teacher identi- 
fics a student who is particularly adept at conducting ex- 
periments: An art teacher identifies emerging talent, 
^jj these events include observations of behavior or 
products as well as judgmerits abbut studerit develbp- 
irieht. AlthbiigH exercises are neither pfep[anned nor 
highly structured, students' activities nontheiess yieid 
performance assessments, and decisions are based on 
results: 

How can the qoaiity of these informal assessments 
be ensured? Obviously the decisions to be mLade or the 
performance criteria can riot always be specified iri ad- 
vance, nbr cari the exercises arid responses be carefully 
matched to the test purpose. Moreover, structured 
scbfirig procedures are usually out of the question: Yet 
these informal observations also need to be free from 
bias, valid, and reliable. How can this be accompUshed? 
Here arc some sugge.stibhs: 

j. Understand how. class room _circumslarices riiay im- 
pact student pHsrforrharice. Be careful about mak- 
irig unjustified inferences or generalizations from 
Judgments based on spontaneous observatooris. Be 
sure that the poorly performing student was tb- 
cn.sed on the activity and motivated tb put forth a 
best effort. Similarly, check tb be sure that the 
high-scbririg studerit did riot have 5ome special ad- 
varitage that accounted for superior performance: 

2. Whenever possible, repeat or devise sirriilar irifbr- 
mal bbservatibris to see if judgmerits are 
cbrisisterit. 

3. Check your judgments with other teachers. 

4. Check yoqr judgments with the student(s). 

5. Miriitriize the chartces of bias by 

a. Remairiirig sensitive to the caUural diftejGtVcts 
ammg students aiid_ the ways Ifiese differences 
may impact performance. 

b. Recordi^ig qbservation^ as soon as 
possible— not relying on memory. 

c. Remaining sensitive to the natural tendencies to 
let prior knowledge influence judgm'^^s^^, mak- 
ing judgmenfs excessively strict br leriierit, 
etc.; trying tb be aware bf your attitudes to- 
ward studerits arid remaining objective: 
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Finally, as a_ general rule, if you need to be certain of 
freedom from bias; reliability; and validity; because a 
major decision rests in the balance, do hot rel_y oh 
spohlaheous observations. Use structured pcrfdrrhance 
assessineril. 



CONCLUSION 

This brief guide has covered a great deal of infor- 
mation, it has defined and illustrated performance assess- 
ment, taken you through the process of designing an 
assessment, and suggested ways to rriaximize the quality 
and use of ybUr pcrtbrrhance assessments. To assist 
you in maximizing the quality of these assessmcfiis, a 



''Qualiiy Cqmrbl Checklist" follows. It iisis each fac- 
tor discussed in this chapter. 

Tte guide began with the assiimptibri, based on re- 
search in classroom assessment, that you already know a 
good deai abom this lype of assessment, e^e^fi though 
you rhay ml febei it or >;ybdivlde it into compoheiit parts 
as has been done here. The goal has been to provide a 
coherent mructurc wMn which you may (a) more easily 
pf^an the Jsssessments yb^ lieed and (b) ensure the reU- 
ability mi4 validity of your professional judgments. By 
taking advamage of ^hls structure in planning and de- 
scribing your assessments; your carefully suppor{cd pro- 
fcssibrial judgments will be viewed as objective: arid 
accurate evidence of sJudeht develbprhent. 
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QUALITY CONTROL CHECKLIST 

Check these factors to ensure quality performance assessments: 

Reason for Assessment 

Specify the decision to be made and the decisionmaker. 

Measure the abihty to use skills arid knowledge. 

Clarity of Commanication 

Give clear task explanation. ' 

Nfake performance criteria and standards explicit. 

Freedom from Bias 

Use tasks that provide equal bpporturiity for all students. 

Be sure that scoring procedures are explicit and raters are trained to use them. 

Avoid mental recordkeeping. 

Rate performance **in the blind" when possible. 

Validity 

Clearly define characteristic to be measured. 

Clearly define levels of proficiency. 

Develop a variety of exercises where possible. 

Use traditional tests and performance assessment in combiriatibri. 

Reliability 

- Use careftiily designed assessment procedures. 

Administer assessment careftiily: 

Prepare the studerit for assessmerit. 

Economy of Assessment 

Use ecoribrriical assessment exercises. 

Use economical scoring procedures. 
Maximizing Quality of Spontaneous Assessments 

Know the mbti -atibn behirid performance. 

Repeat observation. 

i __ _ _ - _ _ 

Check bpiriicns with others. 

^^z^ Be sensitive to sources of potential bias. 
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APPENDIX 

Completed Performance Test Blueprints 



BLUEPRINT OF A PERFORMANCE TEST 
IN BIOLOGY* 

1 . Decision Situation 

A. Reason^sj for AssessirTent — _ 

1. Diagnosis-' to show mastery of the concept 



2; Stu dent evaluation — grades -- 

3 ; Forma tive program evaluatidn--to assess my tie aching of the concept 



B. Decisionmakers 

The teacher will be the decisionmaker, 



C. Knowledge/Skills to Be Assessed 



I. 


Concept of food chains 




2. 


Relationships between organisms in a food chain 




3. 


Knowledge of terms related _to food chains 









E>: Students to Be Assessed 

All students in my class (25 sixth grade boys arid g 



♦Developed by Mike Mitchell, Terra Linda School, Beavertbn, Oregon. 
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2. test Exercise 

A, Nature of Event(s) 

Naturally cKcUrririg classroom everit(s). Descnptibh: 



Structured exefcise(s) Description: Students will construct a drawing- 
showing a sample food chain: 



B. Number of Exercises 

^ One exercise brie time. Reason: Sufficient for simple assessment of 
stu d ^ntis' strengths and weaknesses. 

More than one exercise at one time. Reason: - 



More than one exercise over time: Reason: 



C. Exercise Administration 

X Supervise i by teacher. Reason: Students have vested interest in grade. I will 

hav e- timo to rate; my skills rriay be he cessary to accurately rate product. 

Unsupervised (self-adriiinistcred by student). Reason: 



D. Sample Exercise Description 

Illustrate an example of a realistic food chain from a particular 
ocdsystcm of your chbicG. — i nclud e at -jrears4: five organisms. Label 
each organism and also tell whether it is an bmnivdre, carnivore, 



herbivore, producer, and consumer. 



3, Performance tb Be Evaluated 

A. Forms of Pcrfbrmancc 

Process rating. Describe: 



J< Product rating. Describe: Illustration of a food chain 
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B. Specific Performance Crileria 

--Five organisms included 

--Correct placement of org anisms in food chain 

--Correct labeling 

--Correct representa tion 



€: test Awareness 

X - 

Open, public assessment. 

Uribbtnisive observation: Reason: 



4. Rating Procedures 

A. Type of Score 

Holistic. Assessment purpose: 



Diagnosis of mastery of concept 

Analytical. Assessment purpose: 



B. Rater 

j( 

^ Teacher rates own students 

Other teacher 

- Peer 

Self 

C. Rating Method 

Checklist 

X (letter grade) 
Rating scale 

Anecdotal record 

■ Mental note 

D. Iriterpretatibri Plan 

— Norm-referenced. Reason: 



I have a preset standard of an acceptable 
Criteribri-referericed. Reason: 

product. 
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BLUEPRINT OF A PERFORMANCE TEST 
IN DRAMA* 



I . Decision Situation 

A: Rcason(s) for Assessment 

Certif ica tibri--mast:ery of skills 

Grading 



B. Decisionmakers 

I will make the decisibh (teacl.er). 



C. Knowiedgc/Skills to Be Assessed • 

The strudent: will select: a prose work for oral interpret:at:idn, design an 

appropriat:e iutrbduc tibh , arid preserit: t: he piecie to t:he class , demonstrating 

presentation skills covered in class. . 



The stu dent will demonstrat e skills discussed in class sessions: 
--iritrbductidry development — how to select matierial 



--poise and stage presence --vocal coloration 

--eriunciatibri --physical handling of material 



--eye contact --facial expression 



D. Students to Be Assessed 

Junior high begi nning drama cburse (mixed--grade s 7, 8, and 9) 



♦Developed by Jcwely Sandoz, Mt. View Junior High School, Beavertbri, Oregon (Drama Teacher) 
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A. Nature of Eveni(s) 

Naturally (KCiirring classrborri everii(s). Description: 



-X ^ J ' y r. • ' Students will be given a date to perform 
Structured excrcisc{s) Description: 



for the class . 



B: Number of Exercises 

One exercise brie time. Rcasbri: 



, Students will have the opportunity 

More than one exercise at one time. Reason: 



to perform twice (for performance variations): 



More than one exercise over time: Reason: 



C. Exercise Admiriistratibri 

X - ^ A grade will be recbrded-^ne eds professional 
SujDcrvised by leather. Reason: ^= 



ass essment . 



Unsupervised (seiradiriiriistered by student). Reason: 



b: Sample Exercise Description 

Students will be called up one a t a time in front of the class_. Each per^ 

son will brfng material on a hard backing. The piece will be introduced 
and then read aloud. Studetit will then ret urn to seat. 



Teacher will conduct an oral evaluatir.i by peers and will present studeni_ 



with a written c ritique sheet and a grade. 



3. Periormancc to Be Evaluated 
A. Forms of Performance 



X - . K fieh?^ vtor dnrfng p resentation will be evaluated. 
^ Process rating. Describe: — ^ ^ 



Product rating. Describe: 
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B. Specific Performance Criteria 

See criteria listed in "Oral Iriterpreta tidh Evaluation Fb rrri" attached. 



C. Test Awareness 
X 

' Open, public asscssmeht. 

Unobtrusive observation. Reason: 
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4. Rating PriKcilurcs 

A. Type oi Score 

Holistic. Assessment purpose: 



X . . Each section of mastery can be individually 

Analytical. Assessment purpose: i. 



examined , 



B, Rater 

^ Teacher rates own students 

Other teacher 

^ Peer (^^^h oral discussion as explained in exercise description) 



Self 

C. Rating Method 
Checklist 



X ^ ' 1 (attached) 
Rating .scale ^ uuduncu^ 



ing 

Anecdotal record 
Mental note 



D. . Interpret at ion Plan 

Norm-referenced. Reason: 



X jr.- There are standards to meet. 
L Criterion-referenced. Reason: ■. 
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ORAL INTERPREtAtiGN EVALUAtiON FORM 



Beginning Drama 
Mrs; Sandoz 



Name of Interpreter: 
Dale: 

Title of Seiectibn: 



1 . Appropriate choice of materia! 

2. Cutting of seiectibn 

3. Scrif5t bri hard backing 



4. Intrbductibri 

5. Handling bf script 

6. Volume 

7. Rate 

8. Articulatibh 

9. Prbhuhciatibh 

10.. Dialogue and character development 

1 1 . Eye contact 

12. Facial expression 

13. Sensory appeals/vocal coloration 

14. Climax communicated 

15. Responsive body posture 



Excellent Good 



Fair 



Pbor 



Additional Comments and Overall Effectiveness: 
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Grade: 



